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Abstract 

Research has determined that specific management techniques can 
have an effect on the classroom behavior of students. . An 

observational rating scale was developed, based on these findings, to 

■ ' r • 
assess the type of management techniques used to control behavior. 

Subjects . were six teachers in a program for behaviorally disordered 

children. Correlational analyses were used to, determine the 

relationships among teacher behaviors, and between teacher behavior 

and measures of. student misbehavior. Implications for educational 

research and practice are discussed. 



/ 



. ; The Relationship Between Classroom Management 

^ . Strategies and Student Misbehaviors 7 ^ 

/The importance of classroom misbehavior, and teacher management 

of ;that behavior, cannot be underestimated in either regular or 

special education. During the 1978-79 school year, one of every 20 

public school teachers in urban areas reported having been physically 

attacked on school property (National Institute of Education, 1978), a 

factor some have suggested might contribute to a higher turnover rate. 

among teachers^MdGuire, ; - 1979). Student misbehavior also has been 

shown to be related negatively to academic achievement. Research has 

shown that a strong relationship obtains between measures of student 

attention and academic achievement (Hoge & Luce, 1979), and that the 

relationship is strongest for low-achieving "Students (Soli & Devine, 

J.976). Inappropriate classroom behavior also may play a key role in 

referral to special education placement (cf. Algozzine, VYsseldyke, & 

Christenson, 1983; Mirkin, Marston, & Deno, in press). 

In recent years, research has begun to focus on the observation 

of specific teacher behaviors and the relation of these to student 

outcomes.. Various research programs have identified a number of 

\ . • . 

teaching variables important in the control and direction of student 

behavior in the classroom. These variables can be grouped into two 

types: immediate and long-term. Immediate variables are those that 

have been observed to have consistent effects on the observed behavior 

of students,, in terms of fewer disruptive behaviors, greater attention 

to task, and so on.„ Long-term variables are those that have been 

correlated with student outcomes that are less directly observable, 

such as grades and scores on achievement tests. An extensive review 



of these variables is provided by Skiba (1983). A brief summary of 
the variables is provided here. 
Immediate Variables 

The positive effects J5f. teacher attenti^n^in increasing 
appropriate behavior- and decreasing, inappropriate behavior have been 
demonstrated in a number of studies (e.g., Cooper, Thomson, & Baer, 
1970; Hall, Lund, & Jackson, 1968; Madsen, Becker, & Thomas, 1968). 
O'Leary and O'Leary (1977) outlined three characteristics necessary 
for teacher attention to function as a reinforcer: it must be 
contingent upon behavior, it must specify the desired behavior, and it 
must be delivered by the teacher-^in a sincere and credible^ manner. 
Inconsistent results regarding the use of praise as a reinforcer (Good 
& Grouws, 1977), however, have led some to suggest that praise is not 
always intended as a reinforcer, since it is often not delivered in 
accordance with these specifications (Brophy, 1981). - 

The use . of token economies also has been found to be effective in 
decreasing ' disruptive behavior and shaping appropriate behavior 
(Kazdin, 1977; O'Leary* & Drabman, 1971). JReinforcers that have be>en 

found to be effective in such systems include free-time (Conch & 

\ . . . 

Clement, 1981), sports activities (Hansen, McLaughlin, Hansaker, & 
Young, 1981), and video-games (Robinson, Newby, & Ganzell, 1981). 

Many writers have suggested that when behavior problems are 
severe, or are being reinforced .by peer attention or other 
environmental contingencies, some form of direct intervention may be 
necessary, in conjunction with a positive program, /tg control the 
behavior (Jones & Miller, 1974; Mattos, Mattson, Walker, & Buckley, 

■ ■ . x / 

/ 



— 1969). A number of interventions have been shown to successfully 
reduce classroom misbehavior. Of these, time out from positive 
reinforcement has been found to be successful most often (cf. Powell 
& Powell, 1982); j Other successful^ interventions have included 
contingent after-school time fSwanson, 1979),^ loss of tokens or 
"response-cost? (Pace & Foreman, 1982), and the use of reprimands 
delivered in a soft tone of voice (O'Leary, Kaufman, Kass, & Drabman, ' 
1970). ' 

The effectiveness of classroom management also may be mediated by 
the degree or type of cognitive .structure present, i.e., the use of 
classroom rules. Herman and Tramontana (1971) reported that token 
reinforcement failed to decrease high rates of misbehavior unless used 

i ■ . 

in conjunction with specific instructions about appropriate and 
inappropriate behavior. Evertson and Emmer (1982). reported that rules 
were most effective when presented clearly and enforced consistently. 

The work of Kounin (1970) suggests that more effective classroom 
managers evidence a higher degree of awareness (i.e., "withitness") . 
Teachers who more often ask students about their progress on assigned 
work and alert off -task students that they are liable to have their 
work checked have been shown : to have significantly fewer behavior 
problems in their classrooms (Borg & Ascione, 1982). Evertson and 
Emmer (19821 reported that the most highly significant dii^erence 
between effective . and ineffective classroom managers was on the \ 
variable "effectively monitors student progress' and completion of ( 
assignments." 
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Lon^g-Term Variables 

One of the more significant findings of observational teacher 
effectiveness research has 1 been that amount of student learning is 
directly proportional to amount of time actively engaged in academic 
learning. In the Beginning Teacher Evaluation Study (Fisher, 
Berliner, Filby, 'Marliave, Cahen, & Dishaw, 1980) both the' amount of 
time allocatecT to student instruction . by the teacher, and the 
proportion of time the student was actively engaged, in learning 
correlated positively with student performance oh achievement tests. 

The characteristics of the instruction that students receive also 
have been^ explored in relation to academic outcomes.,^ Teacher 
variables that have been shown to be important in predicting- academic 
outcome have included teacher feedback and corrections p ; f student 
responding (Anderson, Evertson, & Brophy, 1979; Brophy^i Evertson, 
1976], highly structured teacher-directed academic activities 
(Stal lings, 1975; Stevens & Rosenshine, 1981), smooth transitions 
between subjects during lessons (Anderson et al., 1979; Kounin, 1970), 
and a rapid lesson pace (Good, Grouws, & Beckerman, 1978; Stall ings, 
1975)'. 

Because of "the different theoretical and" methodological 

■ r 

backgrounds of the researchers investigating these concepts, however, 
rarely are more than a few of these variables studied simultaneously. 
Further, although some have asserted | that teaching behaviors that 
structure the overall learning environment are more important than 
direct behavior " management in maintaining classroom discipline 
(Kounin, 1970), few studies have directly compared the effects of the_ 



two types of teacher behavior. In addition, with the exception of 
reinforcement and punishment, few of the variables identified as 
important in classroom/ management have been studied in settings 
devoted to special populations. It seems likely that such 
environments, smaller classrooms composed of children with more 
ihtenseJ)ehavior or learning problems, would require different teacher 
behav i or s^f^ success than would larger, regular classroom settings. 

The purpose of the current study was to observe and compare the 
effectiveness of various teacher behaviors in the management of 
behavior disordered children.^ Using the. findings of observational 
classroom literature, a rating scale was developed to allow 
observation of a number of teacher !j behaviors simultaneously. In 
addition to comparisons oi' specific 1 behaviors, aggregation of the 
scales facilitated comparison of the effectiveness of immediate and 



long-term .vfiriables. the /effects of. teacher attention and general 
classroom structure on student behavior also were compared. 

j Method 
Subjects . g 

Subjects were six teachers in a public school program for 
behavior disordered children in a large upper midwestern city. The 
majority of the students in the program had been referred for 
Inappropriate behavior in the classrodnu 

""the program ( for these . students was more structured than the 
regular education program... A school time-out room (with time-out room 



aides)- was available wherr^assroom^beh^ foo~~severe, and 



access to privileges was contingent upon behavior by means of a code 
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system. In addition, .most of the teachers used token economies in 
their.jcl assrooms on a regular basis. 

Teachers in the^program, however, differed in the extent to which 
they used these Drocedures. Although the time to be spent in time out 
was^jpecLfjjecT by school regulations, no regulations gbverned when a 
-student had to be sent to time out. Only 53$ of the teachers reported 
using time out regularly/in the control of misbehavior. Similarly, 
use of the point system varied. Of all the teachers in the program, 
r 67% reported the use of some form of point system; 60^ used some form 
of edible reinf orders, and only 20% used actual tokens as a part of 



their management system, 
the implementation of t 



l ... ' • . 

Thus, there was . considerable variability in 

e behavioral procedures within the program; 



This variability was considered crucial for the purposes of the' study, 

\ J i * 

since it allowed observation of a variety of management styles. 

/ . \ - \ • 

All subjects were asked to participate in the . study by the 

program coordinator. Eight \teachers originally agreed to participate, 

.'./•■• ' \ ■ • 

but two/ later asked not\to be\ included. Three of the six 

/ / " . \ \ ' ' ■ ' ' - | ' 

participating, teachers wor^ced^with students in grades 1-3 .(median age 



= 7.5), and three worked with students in grades; 4-6 (median age 
e mean number of years 

\ . . - \ 



10.2). _The mean number of years teaching in the program was 3.5; the 



mean number of years teaching special education was 7.8. The median 
number of students in participating classrooms was 



9.5. 



Measures and Observer Training 



The Classroom Manag ement Obsery^ i^JSgale .-(.CMOSX was-des i gned-to- 



assess the style of teacher management in the classroom. It consists 
of 11 scales: 10 individual five-point scales and one variable rated 




-on a two-point scale . of present or absent... All were uniformly scaled 
j in a positive, direction, that is,va higher rating represented a 
-greater frequency or degree c^f the behavior being observed; behavioral 
definitions were provided for both ends of each scale. The scales 
represented variables that prior researcffliad shown to be correlated — 
with improved student behavior or. higher' academic achievement. 
Defining characteristics of the variables, as well, as respresentative ^ 
studies that have investigated these characteristics, are. presented in 
Table/ 1. Operational definitions actually used by the raters and a' 
sajnpl'e protocol are included in .Appendix A. , 



\ 

. \ Insert Table. 1 about /here 



... i. v 7 . 

Four observers were trained in the/ise of the CMOS and given the 



opportunity to practice rating two videotapes of classroom situations 
(only three' of these, observers later participated in classroom 
observation; the investigator served as the fourth observer).- The 
l first tape showed a. teacher, described as highly effective by both 
peers and superiors in a regular classroom situation with three 
students. After viewing and rating the first tape, observers compared 
ind discussed ratings and came to \ consensb.^ regarding the 
£ "appropriate" rating on each variable. TYtey then viewed and rated a 
second tape, in which the same teacher had.&een instructed to "act as 
a poor teacher would." These two tapes gave raters the experience of 
rating at both ends of the scales. 

j . Inter-rater agreements, defined, as ratings within one ^scale 
point, were calculated for all observers on both tapes. Agreement 
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coefficients between observers on the first tape ranged from .82 to 
1.00, with a mean of .89; observations of the second tape yielded 
coefficients ranging from .73 to .81, with a mean of .85. Only two 
coeff icients *out of 20 failed to exceed .80, the level of agreement 
usually recommended in the literature (Keller, 1980). 

The dependant variable, student misbehavior , was measured, by 
means of a, frequency count system devised by Deno (1979). This method 
combines time sampling and frequency counts; the observer records all 
instances of a given behavior in a 20-second interval', then counts all 
instances of the next behavior category >fgr the. next 20 seconds, and 
so on. The original system provides four categories of behavior: 
noise, out-of -place, physical contact or destruction, and off-task. 
During the first classroom observation, however, the frequency with 
which physical contacts occurred was extremely low. Thus, this 
category, was dropped to allow additional observation time for the 
other three categories. Definitions of the behaviors observed, and a 
sample protocol, may be found in Appendix Bl Observer trafhTng^for 



the behavior coding 0 system also was provided \ Jby means of videotape. 
Inter-observer agreement coefficients between two pairs of observers 
were .67 and .90. -y 

Reliability checks also were conducted for/ both measurement 
instruments during classroom observation, as a check on what O'Leary 
and Kent (1973) refer to /as "observer drift." , Inter-observer 
agreement across all CMOS^ scales ranged ,from .80 to .82.: Analyses of 
the inter-rater agreement for each Cm6s scale indicated that most 
scales showed good agreement, with the exception of classroom rules 



( .62); positive attention (.57), and transitions (.57). All other 
scales showeft^4Ahin-one point agreements ranging from .89 to 1.00. 
However, exact agreement among observers was considerably lower, 

./ • \ ■ 

ranging from .20 to .50 across, scales, and from .40 to .82 for the 11 
scales. Inter-observer agreement on the Classroom Behavior Frequency 
Counts ranged from .70 to\ 1.00 (average for total score = .82) when 
the criterion was the same number of behaviors per interval. When the 
agreement criterion was that the same behavior was coded during an 

interval, agreement ranged from .30 to 1.00, with the average for the 

- / / • r ' ! 

total scor^being .67. ^ 

Procedures „ 

Classrooms were observed three times during the fal 1 of the 

school year* ^The first 1 observation took place in October, six weeks 

after the beginning of the school year. The -second observation 

occurred three weeks later, and the last four , weeks after that, 

shortly before the 'December break. Classroom observers were stationed 

in observation, rooms adjoining the classroom. The four observers were 

rotated in all classrooms, and no observer was in a given classroom 

more than once. 

Each session began with 20 minutes of observation time on the 
CMOS. During this time, observers were encouraged to refer to the 
scale/ definitions frequently to guide their observations, but were 
instructed not to rate until the full 20 minutes had passed. A five 
minute.; block of time was allowed for scoring the teacher on the 11 
'scales. The observer then recorded student misbehavior on the 
Classroom Behavior Frequency Count for 20 minutes. Clipboards 



10 

equipped with a timing device and earphone signaled the beginning of 

each new interval to the observer. 

. i 

Data Analysis ■ 

; ' * ..- .... ...... \ 

Descripti ve^data are reported for each of the .three observations* 

Correlations arnong the dependent variables (student misbehavior) and 

• "J- /' ' ' 
the independent variables (teacher classroom manaqement ratings) are 

based on the aggregation of data across all three observations for 

both dependent and independent variables. Since classroom size ranged 

from 5 to 10 students during observation periods, all student behavior 

data are controlled for class size. Although the correlational data 

are useful in describing relationships among the variables, caution is 

advised in interpreting or attempting to generalize the results, due 

to the small sample size. Statistical analyses also were performed^tq 



determine, the reliability of r ; . measurements nstruments. The results 
of these analyses are reported in Appendix C. * 

Results 

Description of Teacher and Student Behaviors 

i 
1 

Teacher behavior . The means and standard deviations for the 11 
CMOS scale items indicated that, on the average, use of the variables 
was high in the classrooms observed (see Table 2). These results may 
b^ somewhat skewed, however, by the high use of the variables by the 

teacher's in grades 4-6. Breakdown of the variables by primary (grades 

/ 

l-3) 7 and intermediate (grades 4-6) classrooms showed large differences 
between the two groups of teachers on all the variables except 
positive attention and back-up reinforcers (see Tiable 3). '/. 
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Insert Tables 2 and 3 about. here 



. . . Analysis of the data across .observations did yield some 
consistent trends. Use of feedback and corrections, and classroom 
rules, tended to increase over time; smooth transitions, structure of 
the lesson, and pacing and enthusiasm tended to decrease over time. 
Given the standard deviations of the items, and the low exact 
reliability of the scale, these results must be interpreted with 
caution. /' 

Student behavior . Actual numbers of student misbehaviors varied 
widely across classrooms. During the third observation, for instance, 
jthe total number of .inappropriate behaviors counted in any given 
classroom (unadjusted for class size) ranged from 0 to 122 over the 
course of the 20-minute observation period. 

Analysis of the\number of behaviors emitted per child (see.Table 

j 

4) and percentage of intervals in which a behavior occurred (see^Table 

5) yielded somewhat contradictory results: mean number of off-task 
and total behaviors per child appeared to increase dramatically over 
time, while the same data measured as a proportion of totjal time 
appeared to decrease. In fact, the truth may lie somewhere in 
between. While frequencies of the observed behaviors did! tend to 
increase over time in all classrooms, the results atN N Time 3* were 
somewhat skewed by a dramatic two-fold increase in oje of the 
classrooms. The proportional interval data tend to underestimate the 
behavior, since the use of proportions imposes a ceiling effect on the 



data (Haynes,- 1978). Nevertheless, both approaches indicate that, in 
tbe ; classrooms studied, off -task, behaviors occurred most frequently, 
fojflowed by noises and out-of -seat'behaviors. „.! 

Insert Tables 4 and 5 about here i 



Relationships among teacher behaviors . Pearson product 
correlations, among the aggregate ratings of teacher behaviors are 
presented in Table 6. The results indicated that, with the exception 
of positive attention and back-up reinforcers, the. variables were 
moderately to highly correlated with each other. A number of 
interesting * relationships emerge in - viewing the strongest 
correlations. Teachers who intervened most briefly, . consistently, and 
specifically when dealing with inappropriate behaviors also responded 
more immediately and were ih general more aware of the students in 
their classrooms; Teachers with more structured lessons also tended 
to deliver more feedback to their students regarding that lesson. 
Classrooms in which the teacher exhibited greater awareness of student 
activity tended to be classrooms, that also exhibited smoother 
transitions, and a higher rate of ..active academic responding. 
Finally, strong: correlations were obtained between pacing and 
interventions for inappropriate behavior, immediacy of consequences, 
teacher awareness, and transitions. 



Insert Table. 6 about here 



13 

Relationships among student behavior s . Correlations among 
student behaviors were strong and stable over time. Table 7 presents 
the correlations among observed behaviors, aggregated across sessions. 

Insert Table 7 about here ■ t 

Relationships among teacher and student behaviors . Correlations 
between ratings on the CMOS and student misbehavior were, in general, 
X^quite strong (see, Table 8). Although high correlations were obtained 
regardless of treatment of student behavior data, only correlations 
^based on the proportion of intervals in which misbehavior occurred are 
presented, since this method yielded greater agreement coefficients 
amciqg observers. Since higher ratings on the individual scales 
• indicate greater classroom structure, one would predict negative 
correlations with student misbehavior: the higher the ratings,* the 
.lower the frequency of misbehavior. The results reflect such a trend. 
Only back-up reinforcers and positive attention for appropriate 
behavior were mildly positively related to inappropriate behavior. 
Interventions that correlated most highly with * r a classroom free of 
student misbehavior were brief, specific, and unemotional; immediate 
consequences, consistent classroom rules, and a brisk lesson pace also 
correlated relatively highly with low rates of student misbehavior. 

.■ ■ • ■ ■ ■ " * «. 

Insert Table 8 about here 



Three sets of aggregate .scales were formed: the first was based 
on a distinction ^between immediate and long-term variables; the second' 
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consisted of a teacher attention scale containing those variables 
relating to teacher attention to individual students; the third was a 
general structure scale, composed of those variables relating to 
teacher behaviors that functioned to structure the classroom 
environment. Although little difference was found in the correlations 
between teacher attention and student behavior, and between general 
structure and\ student behavior, immediate variables involving 
'management of spudent behavior correlated more highly, in a negative 
direction, with 



misbehavior than did long-term variables. 



Correlated vs. effect 



■j ■ 

^VQ^ van 



\ 



ables. Although a rhjmber of 



variables correlated negatively with frequency of misbehavior, the 

ligh correlations among the/ teaching variables may indicate that\ome 

/ ; . \ 

/of the teaching behaviors Relate to decreased disruptive behavior only 

' ■■ ' 7 / ; ■ ■ • " 

because of their correl at/ion with a more powerful teaching behavior. 

/ Put another way,/ some of the variables may just be descriptions of 

behaviors that effective/ classroom managers also happen to engage in, 



although such'y behavioi/s , do not, in and of themselves, control 
classroom behavior. 

Although a full/ analysis of causation and correlation would 
necessitate • experimental manipulation of ■ teacher behavior, "some 
statistical control As possible through partial correlations, where 
the simple correlation between two variables is controlled for a third 
variable that may /also correlate highly with one or ; the other 
variable. Although sample size is, in this case, too small to allow 
judgments about statistical significance, \some trends can be noted by 
comparing simple correlations between a teacher variable ;and student 
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behavior, and correlations between those variables controlled for 
other teacher behaviors* 

In a series of partial correlations, interventions for 



inappropriate behavior and immediacy of consequences were the only-* 
variables unaffected by controlling for. other teaching Variables. The 
simple correlations for interventions for inappropriate behavior were 
'around -.95; controlling for other variables yielded partial 
correlations that ranged from -.60 to -.96, with the majority of 
correlations around -.90. Immediacy of' consequences was more" 
affected, but first order partials still, ranged from *„51 to ,-.-97, 
with the majority of correlations around -.90. Other correlations 
changed dramatically by partial ling out the variance due to other 
variables: teacher awareness, transitions, pacing and enthusiasm, .and 
classroom rules (variables that had correlated strongly with low rates 
of misbehavior) evidenced weak negative or even positive correlations 
with student, misbehavior when controlled for interventions for 



inappropriate behavior or immediacy _of consequences. Feedback and 
corrections, and lesson structure may be mutually dependent^ although 
correlations with student behavior remained' healthy when controlled 
for other variables, when controlled for each other, originally strong 
rtegative correlations with misbehavior were reduced to -.39 and -.37, 
respecti vely.^ ■ 

Further information also was provided about aggregated variables 
through partial correlations. While the! correlation between the 
immediate variables and total misbehaviors dropped onlAf moderately, to 
-.50, When controlled by long-term variables, the partial correlation 
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between long-term variables and misbehavior was .09 when partialling 

out the effect of immediate variables. Teacher attention showed a 

'similar stability in comparison to/general structure, suggesting that 



whatever power lorig-term structuring variables have in control ling 
classroom behavior arises only in conjunction., with immediate 
management variables involving /teacher attention. 

/ / Discussion 

/ ~ ■ .. 

One of the difficulties with observational classroom research, 

. , : -./ > ■ < ■ 

more common to the broad studies of process-product research than to 
the- narrower focus of behavioral research, might be called the problem 
of correlated vs. effective variables. While many variables have been 

shown to relate to student outcomes in purely correlational studies, 

■ ' . / * • " * . ■ * 

it seems likely that at least some of these variables . acquire their 

predictive power solely through their association with variables that 

may play a more/direct causal role. V Partial correlations among the 

CMOS variabl es revealed that only Interventions for inappropri ate 

behavior andl/immediacy of consequences were relatively unaffected by 

controlling for' other behaviors. The same analysis reveale'd that 

feedback/ 7 and lesson structure seemed mutually dependent, although 

relatively unaffected by other variables. A similar process is 

doubtless at work in the regression analyses: of many process-product 

studies, and: may in part account for the small percentage of variance 

explained by many processrproduct variables. 

/ Another, point of interest was the strong relationship, among the 

/ ... " • • 

' different behavior codes. Noise, out of seat, off task, and their 
summation all correlated highly with each other, and acted similarly 
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in relationship with other variables. This may have something to do 
with the definitions of student behavior* These behavior codes, like 
many used in educational research tend to be, topographic and 
structural: the important differences .between the operational 
definitions of 'noise 1 and 'out-of-seat 1 concern the parts of the body 
with which they are emitted, Thompson and LubinsM (1982) argue that 
behavior is defined more aptly through a functional analysis, that- is, 
in terms of the stimuli and consequences that shape, and maintain ij. 
The present results support such an interpretation, since behaviors 
that differ topographically seem to have the same controlling 
variables, providing some evidence of functional equivalence. 

The results clearly showed, for this sample of classrooms, . the 
importance „of direct management variables over indirect structuring 
variables, .and in particular the importance of managing inappropriate 
behavior. While the small sample size does make generalization to~ any 
larger population >isky, some observations can be made. The current 
results tend not to support the hypothesis of Kounin (1970) that 
indirect structuring variables such as smoothness and momentum- 
(transitions and pacing in the current study) are., more important in 
maintaining classroom .discipl ine ! than teacher behaviors specifically 



intended to manage behavior. They do support ,. the experimental 
findings of Jones and Miller (1974) and others that some form//of 
direct intervention is necessary to control misbehavior, especially 
for children with more severe behavioral problems^, and that/such 
interventions are most effective when delivered immediately, briefly 
and .unemotionally, and with a degree of cognitive structure. 7 
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The* failure of either social or- tangible reinforcement to 
correlate with decreased disruption in this sample was surprising. 
One explanation may lie in the fact that -positive teacher attention 
and back-up reinforcers were used with a certain uniformity in all 
classrooms observed, while interventions for inappropriate, behavior 
varied widely. This suggests that praise and token systems in such 
classrooms" only acquire their power in conjunction with actions 
designed to control behaviors directly. If children are receiving 
peer attention (or even teacher attention) for misbehavior, positive 
reinforcement^ alone may be insufficient to extinguish the 
inappropriate behavior. . 

Previous research has hinted at -development for 
some -of the Reaching variables studied here. Both-positive attention 
and teacher feedback have been demonstrated to be related to student 
outcomes at some grade levels, . but not at others (Stallings, 1975). 
It is easy tor imagine how other variables, such as classroom rules, 
would also be affected by student developmental level. Thus, the 



differences in implementation of the behaviors between the primary and 
intermediate teachers cannot be taken as an index of teacher quality, 
or the assumption made that, if trained in -these variables, the 
primary classrooms would evidence lower -rates of disruption. An 



alter nati ve-hypothasis_ 
more difficult to carry 



nlght^sugg^t that such teaching behaviors are 
out with younger chil drenT"~~ " — — ~— - — -L 



Al though they must be regarded as-preliminary given the size of 
the sample on which they are based, the current findings suggest that 
caution may be inj order in attempting to generalize the findings of 
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process-product" research to special populations! While most of the 
variables did correlate with student) behavior, .outcomes, partial 
.cornel at i ons— reveal ed that many~of the \ teach ing strateg lies acquired 
their predictive power only in conjunction with other-, more 7 directly 



correlated variables. ! Thus, teaching behaviors found effective in 
regular classroom management may be dependent on their relationship 
with more direct management strategies in special classroom settings. 

Active interventions designed to extinguish classroom misbehavior 
proved to be the most important dimension of classroom behavior 
management for this sample. Such results selrve to underscore the need 

i : 

for further research into the parameters of punishment-related 
management strategies, such as time put, reprimands, or response cost. 
Ethical objections to such techniques may be well intentioned, but 
will not substitute for actual data, especially when such techniques 
are already in use in special/ education programs. While ethical 
considerations may preclude radical manipulation of punishment-related 
interventions experimentally, fth.e use of such techniques varies widely 
enough (even irt the present /smaller sample) to permit observational 
comparisons of naturally occurring interventions. 

The new observational research methodologies in classroom 

\ 

resejarch do offer a hopeful /sign./ Static variables., such as the label 
"emotional disturbance,' 1 encouraged classification and removal from* 
the mainstream of the chi yd so labeled, and implied a genetic, or. at 



least deep-rooted environmental ly-based disorder. The new emphasis on 
teaching behaviors implies that .student behavior can be effectively 
managed or directed in/ the current environment, thus encouraging 
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720 I 

remediation. Such a shift in perspective 1 can only be of benefit to 
children in both regular and special education. 
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! ... Footnote - 

This paper is based on the author's research toward completion of 
a master's thesis, which was supervised by Dr. James Terwilliger. 
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Table 1 

Effective Teaching Behaviors : Parameters and Research Support 



Variable 



Effective Characteristics 
(Most Effective When:) 



Positive Attention for 
Appropriate Behavior 



Back-up Reinforcers- 



Interventions for 
Inappropriate Behavior 



Immediacy of Consequences 



Classroom Rules 
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Contingent upon appropriate classroom 
behavior 



Includes some non-verbal' element 
Specifies desired behavior 

-Tak«ns-oF-po1nts-€xchangecLb.l£j.0L 
tangible reinforcer , 
Contingent upon desired classroom 
behavior 



Hall, Lund, i Jackson (1968); Madsen, 
'Becker, Thomas (1968); Sharpley & 
Sharpley (,1981 ) , 

Kazdin &/K1ock (1973) 
O'LearyZ&O'Leary (1.979) ^ j 

Kazdin/ ' 



O'Le/ry & Drabman 



Jones & Miller (1974); O'Leary/et al. 
,(1970) 

/Gluek & Gluek (1952); Deur. ft/Parke. ■ 
i (1970) 7 

Parke & Walters (1967); Anderson, 
Evertson & Brophy (1979) ' 

Aronfreed (1968); Walters, Parke, & 
Cane (1965); Evertson I Emmer (1982) 



Delivered briefly and unemotionally 

Delivered consistently 
behaviors and students ( 

Specifies target behavior and/or 
desired alternative 

Delivered immediately after onset of 
misbehavior 

Delivered before misbehavior spreads Jones. & Miller (1974); Kounin (1970) 



Provide cues for students tin where 
they should be and what they should 
be doing 

Clear and specific 
Applied consistently \ 



Haring'S Phillips (1972); pecker, 4 
Engelmann & Thomas (1975) ; Parke n 
(1969) • , . \ 

Evertson & Emmer (1982) 
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Table.] (continued) • 



Variable 


Effective Characteristics 


Cited In: .. • 




(Host Effective When:) 





N 
00 



Teacher Awareness - Teacher demonstrates awareness of Kounln (1970); Borg & Ascldne (1982) 

student off-task or disruptive 
behaviors j 

\- Teacher monitors/ student progress Evertson I Eiimer (1 982) ; Stall Ings , 
and completion of assignments ■ 1 (1975) / 



Feedback 4 Corrections - Teacher provides feedback on the Brophy ft Evertson Good & 

correctness of/responses on an , Grouws (1977); Anderson, Evertson, 
individual basis ■ & Brophy (1979); Fisher etal, (1.980) 



icUvt.^ 



;4-980-)-;-Brophy-&— 



hours to academic subjects % Evertson (1976 

- Lesson evokes active, observable Stagings (1975) 
responses / 

Teacher Directed Learning - The teacher, not the student 1s Stevent & Rosenshlne (1980); 

~ firmly In control of the lesson Fisher et al, (1980) 

'• - Instruction Is focused on primarily StalJings (1975) ; Rosenshlne (1976) 

;■ " ■ -academic topics 

Transitions , - Teacher provides cues before and Koun1n( 1970); Anderson, Evertson, 

, ; during transitions that specify ■/ ' & Brophy (1979) 
acti'dn students are to take 



Lesson Pacing j - Lesson pace is rapid , ' , Good et al. (1978); StalHngs-(1975) ; 

I - Provides many opportunities for Anderson, Evertson, & Brophy (1979^ 
I student response . 



Us/ 



Table 2 
CMOS Scale Item Means 



TIME 1 TIME 2 $ TIME 3 . OVERALL 
1 '(SO) f (SO) I X (SO) X (SD) 



SCALE J : i 

1 . Feedback & Corrections 3.33 (1 .63) 3.83 (1 -60)1 4.17 "(1 .33) 3.78 ( .75) 

2. Positive Attention 3.5 (1.05) 3.50 (i. 51 J 3.33 (1.37) 3.44 (.935) 
Bonus: Back-up Reinforcers 1.33 (1.03) 1.00 (1.045) 1.37 (1.10) 1.11 (.54) 



-3— Iirterventionrfor- 



Inappropriate Behavior 3-67 (1.75) 4.2 (.837) 3.83 (1.33) 3.94 (.98) 

4. Immediacy of Consequences 3.83 (1 .60) 2.8 (2.05) 3.67 (1 .37) 3.53 (1 .23), 

■ 5. Teacher Awareness 3.33 (1.51) 3.5 (1 .38) 3.5 (.837) 3.44 (.96)' 

SCALE IX 3.80 (1.36) . 3.91 (1.33 ) 3.90 (1.05 ) 3.85 (.76) 

SCALE 2: 

6. Classroom Rules 

7. Transitions 
, 8. Lesson Structure ' 

9. Active Acad Responding 

10. Pacing & Enthusiasm 
SCALE 2 X 3.96 (.87) 3.72 (1 .33) 3.59 (1 .06) 3.69 (.93) 



3.25 (2.06) 


3.4 /(L.67)* 


4.67 (.577) 


3.57 (1 .39) 


4.00 (1.41) , 


3.8// (1 .64) 


3.17 (1 .72) 


3.33 (1.32) 


4.50 (.837) 


4.33 (1.21) 


4.0 (1.10) 


4.23 (.65) 


4.0 (.894) 


3.V (1.52) 


3.67 (1.21) 


3.72 (1.02) 


3.67 (1.60) 


$33. (l.ft 


3:17 (1.33) 


3.39 (.77) 



TOTAL SCALE X 3.87 (1 .11) 3.79 (1 .28) 3.77 (.93) 3.77 (.84) 
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Table 3 

Differences Between Primary (Gr 1-3) and Intermediate 
(Gr 4-6) Classrooms on CMOS Ratings 



Primary 



Intermediate 



Teacher Variables 

Feedback and Corrections 
Positive Attention 



Bac KTffnteffrf Greets—- " 

Interventions for Inappropriate 
Behaviors 

Immediacy of Consequences 

Teacher Awareness 

Scale X 

Classroom Rules 
Transitions » . 

Lesson Structure 

liu: 

Active Academic Responding 
Pacing 
Scale X 
Total X 

Student Variables 

No1se/Ch1ld 

Out of Seat/Child 

Off Task/Child 

Total, Behaviors per Child 



3.33 
3.22 
1:11 
3.22 

2.67 
2.67 
3.24 

2.61 
2.22 
3.78 
2.89 
2.89 
2.88 
3.06 

2.67 
1.64 
5.34 
9.67 



4.22 
3.67 

1.11 . - " 

4.67 

4.39 
4.22 

4.46;, y 

5.00 (n*2) 

4.44 •'• 

4.78 

4.56 

3.89 

4.51 

4.48 : 

Range of # of 
(Behaviors/Classroom) 

.28 , 0-32 : 

.40" ' 0-28 

1.51 0-62 



2.13 



0-122 
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Table 4 



Mean Behaviors/Child 



i 'i 



Time 1 
J (SD) 



Time 2 
it (SD) 



Time 3 
I (SD) 



Overall 
J (SD) 



Noise ' 
Out of Seat 
Off Task - 



Total Behavior 



1.11 (1.40 . 92 (1.65). 2.04 (3.04) '1.45 (1.95) 

.70 (.95). .54 (.48). 1 .64 (2.72) 1.02 (1.14) 

u ' t . 

3.83 ( 3.94 ) 4.83 (4.16 ) 8.38 (11.24 ) 5.90 ( 5.78) 



>Sf for Time 1 and Time 3, H. 
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Table 5 



Percentage of Intervals in Which Behavior Occurred 



Noise 

Out of Seat 



Off Task 



Time 1 



I 





Time 2 



Tile 3 





,73 (.282| ■ ,71 (.281) 




Overall 



I 




,25 (.283) .33 (,231) ,33 (.311) 



.31 1,298) ,19 (.120) .28 (.333) ,26 (.173) 



.69 (.294) 



Total Behavior , .48 (,296) .47 (.260) .42 (.317) .46 (.257) 



f ■ \ 



f 



Correlations Between Scale Ratings Aggregated Across Time 




. 0 0 «■ // » 

XI S C eS « V« t 3, o J «j 

cm v f . o« oo s * 2 ? 2*. 

0 5 4»kM. >.C < E 0 «M UC 

*S • • , > ;.CAV ^ g. w . 

0*» > ft' V 000 «3 J. P - «* ■ ,. " * 

aa. *j I a> flo c q w « o . »o 

ilk vi o wflfi ic y. « £ j(| / 

HO 0 fl CCO B 0 0 t- o oo 

io a \ to hmcq hu h u h j <tf 



feedback and. Corrections , 


1,000 , 


















Positive Attention 


. ,391-' 


1,000 
















Backup Reinforcers 


.290 


,320 


l.OOp 


' * 












Interventions for : • -; 




















Inappropriate Behaviors 


,739 ■ k 


,105 


•;363 ' 


1.000 












Immediacy of -Consequences 


,646 .. ' 


' -.032 


,.,453 


,982 


1,000 










Teacher -Awareness 


■ 0 


,306 " 


.,369 


.863 


.853 


1,000 


i ; ■ 

i 






Classroom Rules ■ 


,119 


,604 


.,241 , 


,230 


,096 


.268 


• 1.000 






transitions^ / 


,787 1 


,415 


,062" 


.830 ; 


,788 


,880 


,070 


1.000 - 




Lesson Structure •/, 


,BS5 1 


,195 


,336 


,733 


,658 


.585 


. .061 


.834 


1,000 


Active Academic Responding 


»658 


,365 


,187 


,673 


,653 


.810 


-.112 


M 


,780 


Pacing and Enthusiasm 


,793 


,543 


-,176 


' ,860 


.804 


,830 


,279 


,874 


,630 



1,000 
,728 



Table 7 

Correlations AnK3n^S^u3ent Behavior Codes 





Noise 


Out of Seat 


Off- Task 


Total 


Noise 

Out of Seat 
Off- Task 

Total 


1 .00 
1 .892 
.875 

- .947 


1.00 
.918 
.956 


1.00 
.972 


1.00 



a All correlations significant at p <; .01 . 



ill 





Feedback and Correlations 

Positive Attention 

Jack-up Reinforcers 

Interventions for Inappropriate 
Behavior 



Immediacy of Consequences. 


! ' -.835 


/ -.884* 


-.878 


-.919* 


Teacher Awareness 


/ ' -.7.02 ./ 


-.588 


-.756 


j . -.767 


L 

Classroom Rules 


/ -.960*/' 


-.741 


-.838 


-.887 


Transitions 


\ ' . ■ -72/ : ' 


-.661 


-.772 


-.813 


Lesson Structure . 


-•,860 
-'.588 


-.768 


-.742 


-.839 


Active Academic Responding 


-.476 


-.566 


r.644 


Pacing and Enthusiasm 


- : . _ 628 


-.714 • 


-.884* 


-.823 


Scale Mean 


4 -.831 


■-.735 


-.828 


-.879 



b 



All correlations greater than + .73 are significant at the .05 level. 
K all other variables N? \ 

p < .01 ; 
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Appendix A * 
Classroom Management Observation. Scale 
Operational Definitions 



TEACHER ATTENTION 



1 . Feedback and Corrections 

5— Students receive feedback on the correctness of responses 80% or 
more of the time. For example, mispronunciations or skips are 
corrected by the teacher during oral reading, student work is 
monitored during Independent seatwork,: etc. 

1 — Feedback frpm the teacher 1s provided to less than 10% of student 
responses. _ 

2 ; Positive Attention for Appropriate Behavior 

~ ~~ 5— Teacher '"pra1s¥s"Ttuden't p for appropriate classroom behavior or 
frequently follows desired behavior with some form of positive 
social attention, such as smiles, pats, physical proximity, etc. 
Such praise or attention occurs soon after the behavior it is in 
response to, and usually Includes some specif1cation_of- the ¥ 
desired behavior. / lj 

1 — Students receive little or no attention or reward for appropriate 
classroom behavior. When praise 1s given, it is general in nature, 
or refers to a large block of time ("You're. having a good day 
today, Susie 1 '), and may even be sarcastic in nature, 

Bonus—Add 2 rating points if present. 

Back-up Rei nf orceins— S tuden ts receive points, free-time, food, 
privileges, bV other 'tangible. rewards contingent on desired 
behavior. Nonrtangible relnforcers (points, stars, etc.) 
must be exchangeable for~taTTgtbTe~Wl n f o rc er s i n order to 
" earn the bonus * _ 

3. Interventions for Inappropriate Behavior 

5— Interventions (commands, reprimands or sharp glances, redirection 
of student behavior, detention, time-out, etc.) for student 
misbehavior are delivered by the teacher briefly , unemotional ly, 
and consistently across behaviors and students. The targeted 
behavior 1s specified at the time of the intervention. 

1— Teacher interventions for riegative behavior are drawn-out (nagging, 
lecturing, etc.), critical, or delivered in a harsh or emotional 
manner. Reprimands are global ("your behavior 1s terrible 11 ) and/or 
refer to past as well as present behavior.* 

4. iTOiediacy of Consequences _ 

5~Consequences for inappropriate classroom behavior— from reprimands 
to time out— are-' delivered immediately following the occurrence 
of the student behavior (within 5-10 seconds) . 



Operational Definitions (Cont'd) 

1— Behavior 1s allowed to continue for some time, or even accelerate, 
before Intervention takes place, . Other students may be distracted 
from their work to observe the disruptive behavior, or Join in 
disruptive behavior before teacher Intervenes. Teacher may wait 

^.~„.,~~._ up ^ 0 ^^ an.. 

5. Teacher Awareness 

5— When working i with one student (one-on-one), the teacher is aware 
• of other students in the classroom, giving attention to them 
(even at a distance), or specifying when they may receive such 
./. attention. 

OR 

When working with a group, the teacher 1s aware of , andystrives to 
maintain the attention of, theentlre group even when directing 
attention toward one student. All students receive an approximately 
equal proportion of teacher attention over the course of the 
observation period. 
1— Students are Ignored for long periods of time while the teacher 
works withj>ne student or small group of students. One student may 
receive a disproportionate share of teacher attention over time, or 
the teacher may be engaged 1n an activity separate from students 
(such as ^paper work), allowing the students to work unmonltored. 

II. CLASSROOM STRUCTURE 

6. Classroom Rules 
5-Students are provided w1l/h cues as to where they should, be and 

what they should be,do1ng\ i.e., rulesrof the classroom are Posted, 
directions are cl ear anf specific, students are provided w th clear 
r em1 nders or consequ ences whe n no t-engaged-ifl-ass49 n pd activities. 
Rules and directions arte applied consistently across students 
and behaviors. / . 

1- RulPs^are not specified or appear not to be 1n effect. Student 
is ffee ?o purLTa^v1ties P other than thoj* prescribed by the 
teacher. When applied, rules or directions are inconsistent 
,\ or "made up on the spur of the moment.- 

7. ; Transitions 

5--Trans1t1ons are smofath and orderly. The teacher provides cues 
^directions before and during transition that specify the 
actio students arlto be taking ("Take out your math books 
and turn to page *). Transitions usually take less than two 

minutes. / 
l~Trans1t1ons between activities are spontaneous and disorganized, 
a^d may take up to five minutes or more. The teacher prov des 
oSly very general cues and directions ("Now It's math time"). 
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Operational Definitions (Cont'd) 

8. Lesson Structure .* y ; 

5«— The instruction received by the students is organized and 
businesslike; teacher is firm in direction and control of 
activities. Student is provided with questions, has material 

.-to^ovei^el^ 

being covered in the lesson, and rarely includes non-academic 
conversation. ^ \ 

1—The teacher's lesson is casually organized and Very spontaneous* \ 
Teacher is not committed' to having the student work on a partlc- I 
ular set of materials, and the lesson may change depending on the! 
mood o'f student or teacher. Instructional lessons may be \ 
interrupted to 'include "process" and other non-academic activities!, 
such as discussing student-pr teacher interests or feelings at I 
1 ength. 

9. Active Academic Responding . 

5— The curriculum or lesson evokes active, observable responses. J 

The student is engaged 1n oral or written responding to teacher / 

questions or written material , I.e., reading aloud, writing / 

answers, respond ing to tape o r teacher questions. / 

1—The curriculum Involves primarily passive responding. The major-r 
ity of student time is spent watching others, looking at instruc-/ 
tional materials without making observable responses ( includes 
silent reading), or listening to others read or recite. ' „■ 

10. Pacing and Enthusiasm 

5— The^ pace of the lessdn 1s rapid, with many opportunities for 
student response. The enthusiasm of the teacher is evident in 
frequent gestures, animated facial expressions, frequent attempts 
to involve students in discussion, etc. ^ - 

1-^-The pace of the lesson is slow; the enthusiasm of students . 
S and/or teacher may be low. Few attempts are made' to* encourage 



student response. 



/ 
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Classroom Management Observation Scale 



Teacher ID ir 



Time Observation Begins 



Number of Students in Class. 



Date 



Ends: 



Sub j ect (Reading or Math) '} m 



I. TEACHER ATTENTION 

1. Feedback and Cprrections 



2. Positive Attention for 

Appropriate Behavior 

Bonus: Backup Reinf orcers? (+2) 



3. Interventions for Inappropriate 
_1 _ - Behavior - 



4 . Immediacy of Consequences 



4 .5 



5. Teacher Awareness 

II. CLASSROOM STRUCTURE 
-^-i-^l a ssr oo m--Rttleg— 



/ 



7. Transitions 



8. Lesson Structure 



9. Active Academic Responding 



10. Pacing and Enthusiasm 



2 
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Appendix B , \^ 

Classroom Behavior Frequency Count 
Operational Definition- 



NOISE- Any verbal 1zat1on or sound created by the child designed to disrupt 
or avoid the lesson as defined by the teacher. The noise may be 
generated vocally (Includes "talkouts" or unintelligible noises) 
or non-vocally (as tapping a pencil or snapping fingers). 

OUT OF PLACE: Any movement beyond either the explicitly or implicitly 

defined boundaries 1n which the child 1s allowed movement. 
Tf the child 1s seated at his desk, then movement of any^sort 
out of the seat 1s "out of place." If -the child is working 
with a group, ,then leaving the group is "out of place. 

PHYSICAL CONTACT OR DESTRUCTION: Any contact with another person or another 
person's property which 1s unacceptable to that other person. 

v Includes kicking, hitting, pushing, tearing, taking, breaking, 

etc. , but may also include such_ neutral or positive contacts 
as hugging, if such contact 1s meant to dismay and is unacceptable 
to that person.. 

OFF TASK: Any movement off a prescribed activity which does not fall into one 
of the three previously defined categories, such as looking around, 
staring into space, observing Inappropriate behavior on the part 
of other students, or doodling. A new behavior is counted any 
time the student engages 1n a different off task activity, even 
1f he was previously off task. Neutral activities, such as 
looking up briefly, or scratching ore's ?rm, are not counted if 
_t^stu4€nt^turn^-4^-th e as signe d JaskMithin 5 seconds . _ 
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Appendix C 

Technical Characteristics of Measaremerrtr~l7rst^ 

sample of_teacher behavior 
may produce more accurate descriptions of actual classroom conditions, 
increased complexity of observational instruments may lead to 
increases in measurement error. (Lipiriski & Nelson, 19.74). Thus,. this 
study also addressed the technical characteristics of the measurement 
instruments in an. attempt to determine whether it is possible to 
reliably measure a number of teacher behaviors simultaneously, " Valid 
statements concerning teacher and student behavior cannot be made 
unless reliability of the measurement system can be shown. 
Technical Adequacy of the-CMOS - 

In order to show evidence of validity, a measurement instrument 
must first evidence reliability— that is, freedom from measurement 
error. The reliability of observational assessment devices most often 

r has been assessed^ through' inter-observer agreement, internal 
consistency, and stability over time (Haynes, 1978)/ In addition, the 
special characteristics of \ rating scales necessitate that the 
researcher document the degree, to which the scale is free from rating 
errors such as halo effect (Saal, Downey,. & Lahey, 1980). A number of 
statistical methods have been suggested for this, purpose and, where 
appropriate, have been applied to the Classroom Management Observation 

: Scale (CMOS). ^ 

Stability over time and raters . Correlations between ratings 
that occurred during successive observations revealed that individual 
V scales tended not to/b"e staUTe over time. Of the 11 items* only 

o 
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active- academic responding evidenced even moderate correlations 
v (.44-. 65) between observations jrtMMim^^ The ...atherL. 

variables fluctuated widely in their consistency over time: positive 
attention for appropriate behavior, for example, showed a correlation 
of -.06 between the first and second observations, .68 between the 
second and third observations, and .00 between the first and third 
observations. Results for the total scale score indicated that the 
entire scale was somewhat more stable over time, but still had" a 
relatively low index of consistency across observations. For the 
total scale, correlations between Time 1 and Time 2, Time 2 and Time 
3, and Time 1 and Time 3 were .29, .21, and-. 34, respectively. It is 
important to note that, given a different rater on each occasion, 
rater and observation occasion 4were confounded. Thus, * this lack of 
stability could be' attributed either to lack -of observer agreement 
through observer drift or to /wide variations, in teacher behAvior over 

observations-*— ^—E44her^on<frtr^ exacerbated by the "smal 1 

number of subjects. ' 

Internal consistency ^ Mean inter-item ' correlations "for each 
variable tended to be moderate for Times 1 and 3 and somewhat high for 
Time 2 (see Table C-l). Of the 11 items, only back-up reinforcers 
consistently failed to correlate with other variables, although this 
may be due in part to its measurement by means of a two-point scale, 
rather than five-point scale used for other items. / 



Insert Table C-l about here 
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• Halo and restriction of range effects . Inter-item correlations 
also provide a test for the |resence^of-^i halo effect, the tendency 
for a rater ."to lissfgn^sTrnTT^ 

on a global impression of the ratee (Saal et al., 1980). Higher 
inter-item correlations would tend to indicate the presence of halo 
effect. In addition, if a halo effect is present, one would expect 
averaging ratings over observers .to result in lower • inter-item 
correlations since this would tend to wash out individual rater error, 

V". 

For the CMOS; mean inter-item correlations tended to be moderate, and, 
with the exception of Time 2, inter-item correlations were higher when 
ratings were averaged across raters. Data col lected during the -second 
session revealed higher inter-item correlations; thus, halo effect may 
be evidenced at Time.;.2. 

Res triction of 5 range refers i to the tendency of a rater to 
restrict ratings for all observations ■< to a^tjiyen range; it also has 
been ref erre^ to^ eniehcyi or severity, depending 

on. the location of range restriction. The. most common approach to 
assessing range restriction ; involves calculating the standard 
deviation of the ratings assigned to all ratees on a particular, 
dimension: smaller standard deviations reflect greater? range 
restriction (Saal et al., 1980). The standard deviations for /the four 
observers in this study ranged from 0 to 2.65 (see Table C-2), Three 
of 'the four observers showed moderate to high variability /in their 
ratings across teachers. Observer 3 showed fairly severe restriction 
of . range on a number of scale items. Inspection of the means for 
these items revealed a. uniform tendency for .this observer to rate 
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teachers more highly than other observers, a possible sign of observer 
leniency. 

Insert Table C-2 about here 
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Technical Characteristics of Behavior Counts , 

*■' 

Stability over time and raters . The observations of student 
behavior produced data that were extremely stable over time and 
observer. High correlations between observations of total 
misbehaviors emitted during each observation session provide evidence 
of a high degree of stability between Times 1 and 2 (.97), and Times. 2 \ 
; and 3 (.93), and a moderate degree of consistency between Times 1 and 
' 3 (.47). The inter-session correlations for specific behaviors 
(noise, out-of-seat, off-task) showed similar results. . Thus, although 
rates of behavior emitted within classrooms tended to change over" time 
(see below), relative rates of misbehavior between classrooms were 
remarkably stable. 

Consistency across behavior codes and measures . A high ^degree of 
correlation also .was evidenced among the specific behaviors^observed. 
Correlations between proportion-of-1nterval and absolute frequency 
'data were high, ranging from .86 for noises to .96 for off-task 
. behaviors. Correlations among different, behaviors remained high (.80 
to .90), even under different statistical treatments. 
... Discussion * i 

In the observation and measurement of classrooms, one must be 
careful to view a broad enough sample of the flux of events to ensure 
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"ecological validity" (Kratochwill & Levin, 1978). On the other hand, 
increasing the breadth and complexity of one's measuring instrument 
increases the risk of observer unreliability (Haynes, 1978). 

The present study sought a middle route, observing a variety of 
behaviors simultaneously while defining those behaviors as 
operationally as possible, to rediPce observer error. Vet limitations 
of the rating scale format, as well asjtime and resource constraints, 
may prevent firm conclusions about whether these goals were achieved. 
When ratings on a number of different scales prove highly 
intercorrelated, as, they were for the second observation session, it 
is difficult, if not impossible, to detect whether these results 
follow from rater halo effect or the simultaneous presence of these 
behaviors in the teachers observed. Similarly, the failure of raters 
to achieve. exapt agreement, and the possible leniency errors of one of 
the raters provide qualifications to any conclusions based upon the 
results. But it is still impossible to determine the extent to which 
the extreme instability of ratings of teacher behavior over time was 
due to observer error, insufficient number of observations, or the 
situation-specificity of behavior. While increased time and resources 
for observer training and more extensive observations might allow^for 
better experimental" control, the unsolved methodological . issues 
surrounding rating scales might set an upper limit on the returns that 
a better design might bring (cf. Saal et al . , 1980). 

In contrast to teacher behaviors, student behavior coding proved 
extremely stable over time. Although this might argue for' the 
superiority of low inference coding systems, it also poses the 
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intriguing possibility that teachers cause stable effects while 
varying_in specific behaviors. Some support for this hypothesis might 
be found in the fact that, although changing in frequency within 
classrooms, the relative degree of student misbehavior, among 
classrooms was very stable. In fact, results indicated that while 
student misbehavior remained stable or decreased in classrooms with 
high teacher management ratings, classrooms with low ratings tended to 
show increases in misbehavior over time. Thus, although specific 
teacher behaviors may be variable from point to point in time, "mean" 
levels of those behaviors may serve to establish a "classroom climate" 
that will determine the overall effectiveness of classroom management. 
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Table C-l 

Mean Inter-Item Correlations for the CMOS 





Time 1 


Time 2 


Time 3 


Aggregate 3 


Feedback and Corrections 


. .628 


.715 


.418 


.635 


Positive Attention 


■ .615 


.402 


.298 ' 


. .294 


Back-UD Reinforcers 


.257 


.428 „ 


-.076 


.272 ; 


Interventions for Inappropriate Behavior 


.571 


.493 


... ,588 


.626 


Immediacy of Conseauences 

AllllllwM | MV I V 1 VWII»"'|''" M "W 


.620 


.505 


-.456 . 


.566 


Teacher Awareness 


.322 


.629 


.456 


,605 . 


Classroom Rules 


.501 


.747 


.266 


.622 


Transitions 

1 1 UIM 1 * | vll«l 


.544 


.822 


,563 


.723 


Lesson Structure 


.625 


.731 


.257 


.652 


Active Academic Responding 


. -.111 


.733 


.431 


.651' 


Pacing and Enthusiasm 


.308 


.731 


.402 


' .656 


Mean Inter-Item Correlation \^ 


.408- 


. .634 


.338 


.455 



a Reprisents the mean inter-item correlation when ratings are aggregated (by teacher) across 
rater 1 and time. ' 



Table C-2 

Mean and Standard Deviation by Rater' 



Rater 

1 ■ 2 3 4 ' 





77 

K 


(SO) 


If 

X 


(so) 


t 


(SO) 


i 




(SO) 


Feedback and Corrections 


3.50 


(1.29) 


2.40 


(1,34) 


5,00 


(0) 


4, 


00 


(1,00) 


Positive Attention for Appropriate Behavior 


3.75 


(■95) 


2.60 


(1.14) 


4,25 


( .96) 


3.33 


(1,53)- 


Interventions for Inappropriate Behavior 


3.50 


(2.08) 


3.60 


(1.52) 


5,00 


(0)" 


3.33 


(.33) 


Immediacy of 


3,00 


(2.45) 


3.40 


(1.52) 


5.00 


(0) 


2.33 

( 


(1.53) 


Teacher Awareness 


3.50 


(192) 


3.40 


(1.14) 


3.75 


( .16) 


2,67 


( .58) 


Classrp Rules / 


• U0!U3) 


' 3.80. 


(2.59) 


5.00 


(0) , 


4, 


00 

i 


(1.00) 


Transition / 

/ 


4.25 


(1.71) 


,3,20 

1. 


(1.64) 


4,67 


(.82) 


3. 


D 


(2.65) 


Lesson Structure 

/ 
/ 


4.50 


( .58) 


3.60 


(1.34) 


4.5 


(1.00) 


4, 


33 


(1.16) 


/ ■ ■ ■ • , 
Active/Academic Responding 


4.00 


(.41) 


3.00 


(1.58) 


4,00 


(1.16) 


3. 


33 


(.58) 


Pacing and Enthusiasm 


3,25 


(.96) 


••2,60 


(1.52) 


4,00 


( .82) 


3, 


67 


(.58) 



Ratings presented here are somewhat higher than actual means and may actually exceed 5, due to the coding 
of "not scorable" as a i -in the calculation of standard deviations-. ! 
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